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ABSTRACT 

A nationwide comparative study of the 677 sites using 
DISCOVER or SIGI (computer-assisted career guidance systems) as of 
June 1984 was made. Software-based and institutionally-based factors 
influencing system use were explored. The forser included theoretical 
bases, ease of software usage, and developer's implementation 
assistance; while the latter included staff competence, 
organizational dynamics, financial resources, clientele, 
implementation plan, and system integration with other activities and 
facilities. The sample included 408 respondents (60 percent of the 
677 DISCOVER and SIGI sites surveyed). Multivariate log-linear models 
were used to analyze data in five areas of systems use, and 
univariate analyses were used in two other areas. Results suggested 
that institutionally based factors, not software-based factors, were 
largely determining how DISCOVER and SI';i were used. However, it was 
noted that software-based factors, such as system theory bases, might 
be emphasized more by researchers, developers, and practitioners in 
order to maximize the impact of computer-assisted carear guidance 
systems. (The report includes 10 tables and the survey instrument.) 
(KC) 
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Preface 



This report describes the results of a nationwide comparative 
study of the 677 sites using DISCOVER or SIGI as of June 1984. 
Software-based and institutionally-based factors influencing system 
use were explored. The former included theoretical bases, ease of 
software usage, and developer's implementation assistance, while the 
latter included staff :ompetence, organi zat ion-il d^'^amics, financinl 
resources, clientele, implementation plan, and system integration with 
other activities and facilities. The sample included 408 respondents 
(60.3%) of those surveyed. Multivariate log-linear models were used 
to analyze data in five areas of systems use, and univariate analyses 
were used in two other areas. Results suggested that institutionally- 
based factors, not sof tware— based factors, were largely determining 
how DISCOVER and SIGI were used. However, it was noted that software- 
based factors, such as system theory bases, might be emphasized more 
by researchers, developers, and practitioners in order to maximize the 
impact of computer— assisted career guidance systems. The report 
includes 10 tables and one appendix. The authors acknowledge the 
support and assistance of personnel at the American College Testing 
Program and the Educational Testing Service in completing this 
research . 
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A NATIONAL COMPARISON OF THE USE OF THE USE OF DISCOVER AND SIGI: 

TECHNICAL REPORT NO. 2 

Background 

Computer— assisted career guidance (CACG) systems are becoming a 
major resource in the delivery of career guidance services. National 
surveys conducted by Chapman and Katz (1981) and the Association of 
Computer-Based Systems for Career Information (ACSCI) (1983) have 
indicated that millions of adolescents and adults are using CACG 
systems in a variety of educational and public service settings. 
Har ri s— Bowl sbey (1983) contended that CACG systems have proliferated 
because of their capability to: 1) arouse awareness of the need for 
planning; 2) stimulate broad awareness of potential alternatives; 3) 
teach a process of decision making; 4) provide recent, easily 
accessible information; and 5) provide systematic treatment with 
indi vidual i z a t i o n • 

Research on CACG systems summarized by Cairo (1983), Clyde 
(1979), Harris (1974), and Parish, Rosenberg, and Wilkinson (1979) has 
indicated that after using a CACG system: I) clients react positively 
to it; 2) clients' knowledge of self and the world of work is 
expanded; 3) clients' career and educational plans are more specific; 
4) clients have greater confidence in their career decision making 
ability; and 5) clients appear to be more motivated to use additional 
career planning resource's. While not all CACG systems can equally 
generate these effects, the expanding use of CACG systems and general 
evidence of positive impact supports continuing efforts to develop, 
implement, and evaluate this technology. 

Using the existing CACG literature to guide the future 
development and evaluation of systems has two distinct limitations. 
First, studies vary cons:lder ably in breadth and clarity of information 
describing the treatment conditions, i.e., how the CACG system was 
used to provide servicest Second, very litti'^ data describing 
current national trends related to the design and implemen ta tioo of 
CACG services are available. Consequently, practitioners abreast of 
current career interventions may be aware or this logy^s 
potential effectiveness, but practitioners have little information, 
other than general suggestions sometimes offered by system 
developers, to guide their successfully implementing a CACG system. 

A variety of factors influence the ways in which a CACG system is 
used as a program component; these factors can be broadly categorized 
as either sof twa re — based or ing titutionally ^ based . So f twa re — based 
factors include: a) the theory underlying system design and content; 
b) users'' ease of understanding and operating software, e.g., user 
friendliness, human factors; and c) software developers' assistance in 
implementing softx^are. Ins tit utionally— based factors include: a) 
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staff competence; b) organizational dynamics; c) financial 
resources; d) clientele; e) CACG system implementation strategy; f) 
integration of a CACG systei. with other academic, counseling and 
guidance services; and g) physical facilities. 

In an effort to describe current use of CACG systems on a 
natianal basis, Sampson, Shahnasarian and Reardon (1985) provided data 
on how 438 institutions used a CACG system, DISCOVER (American 
College Testing Program, 1984) or the System of Interactive Guidance 
and Information (SIGI) (Educational Testing Service, 1984). Cai ro 
(1983) and Parish, Rosenberg and Wilkinson (1979) stressed the need 
for comparative evaluations of CACG systems. Comparative evaluations 
...late a CACG system's impav-t on service delivery and user outcomes, 
xhe present study continued earlier work reported by Sampson, 
Shahnasarian and Reardon (1985); data from this study were reanalyzed 
to compo.re DISCOVER and SIGI use. 



Purpose of the Study 

This study sought to identify the dominant factors, either 
software-based or ins t i t n t i onal ly-b as ed , that influenced national use 
of DISCOVER and SIGI. If significant differences exist in these 
systems' use, then software— based factors would appear to have a 
stronger effect on CACG system use than institutionally based factors. 
In this case institutions would need to plan for the resulting 
specific impact of implementing a particular CACG system. If 
significant differences between systems do not exist, it would appear 
that institutionally-based factors dictate CACG system use. In this 
case, institutions would need to plan for the resulting generic impact 
of using any CACG system. The nature of potential differences between 
DISCOVER and SIGI use were also investigated. 



Method 

Choice of CACG Systems 

The DISCOVER and SIGI systems were selected for this comparative 
ai ^l^gis for three reasons. First, and mo?3t importantly, these 

' ' ■'■ have different underlying theore: cal assumptions that have 

their nesign and cof^'c. r _ OVER '« based on an eclectic 

career guidance that ^ .an K^jl rxs-Bowlsbey formulated from 
L.. work of Holland (1973), Prediger (1976; 1981), Super (1957; 1980), 
and Tiedeman and O'Hara (1963). SIGI is based solely on the theory of 
career guidance developed by Katz (1S66; 1968; 1969; 1973; 1980). The 
content of each system reflects the respective differences in theory 
bases . 

DISCOVER consists of four components that include: 1) self- 
assessment (SELF INFORMATION); 2) identification of occupational 
alternatives (STRATEGIES FOR IDENTIFYING OCCUPATIONS); 3) reviewing 
occupational information (OCCUPATIONAL INFORMATION); and 4) 
identification of educational alternatives (SEARCHES FOR EDUCATIONAL 
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INSTITUTIONS). Users, on the basis of self-defined needs, determine 
the number and order of components to complete, SIGI contains five 
components: 1) se 1 f -as s e s smen t (VALUES); 2) identification of 
occupational alternatives (LOCATE); 3) reviewing occupational 
information (COMPARE); 4) reviewing information on preparation 
programs (PLANNING); and 5) making tentative occupational choices 
(STRATEGY). Users complete all five components sequentially, with the 
option of then returning to use any SIGI component. The concept of 
values provides a focal point for use of SIGI, 

The other two reasons for selecting DISCOVER and SIGI were (2) 
the user friendliness /human factors of each system are similar, and (3) 
the level of support provided by both of the software developers is 
similar (although DISCOVER features more direct provision of staff 
training ) • 

Sampl e 

Of the 677 DISCOVER and SIGI sites surveyed, 438 responded, 
yielding a 64.7% response rate. An examination of these sites' 
questionnaires found that 30 respondents (7%) reported having both 
systems. Since the present investigation examined the potential of 
differential system usage among institutions, the results reported 
below were computed from survey respondents using either DISCOVER or 
SIGI» Thus, these results are based upon a sample of 408 respondents, 
or 60.3% of the population surveyed. The reader should may refer to 
an earlier report by Sampson, Shahnasarian , and Reardon (1985) for a 
comprehensive presentation of the descriptive statistics computed on 
all respondents. 



Instrumentation 

A literature review yielded a series of factors potentially 
related to CACG effectiveness. P^esearch questions and an initial pool 
of questionnaire items were developed. A 52 item questionnaire was 
written, "Survey of Institutions Using DISCOVER and SIGI," and 
developers at ACT and ETS reviewed and comnented on its content 
validity^ Other external revievers wi*-b - ^eriLc-r in measurement and 
evalup' ^n - -^e ted on t : 1 l ' cruet i ons , item 

pre^ Liou, and response formats. he original questionnaire was 

shoi ned to 30 items (Sampson, Shaiiiiasar ian , & Reardon, 1985). 

Results 

Distribution of DISCOVER and SIGI 

Twelve respondents (2.9%) used riSCOVER's mainframe version while 
212 respondents (52.0%) used it on a microcomputer or a mini— computer . 
With respect to SIGI, 68 survey participants (16.7%) used it on a 
mainframe or a minicomputer and 116 respondents (28.4%) used it on a 
microcomputer . 
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Descriptive and Multivariate Data Analyses 

The survey Included 30 Items (see Appendix). Several ^^estlons 

allowed for multiple res ases c a single item, A total of 97 

variables we^ aed. Descriptive data on all survey items by 

group are t^-._«^-iited in Table !• 

A multivariate approach was preferred over a univariate approach 
to analyze the data in order to minimize the chance probability of 
obtaining significant results (i.e., committing a Type I error). 
Multivariate log-linear models were used to analyze related data in 5 
areas of CACG system use: 1) institutional characteristics; 2) system 
configuration; 3) integration with other services; 4) counselor and 
staff intervention; and 5) usage statistics. Because of statistics 
considerations (discussed later), univariate analyses were conducts 
on two other survey areas, system management and system 
implement a t ion . 

Log— linear models were used in the analysis of relationships 
between variables cross-tabulated into 'sultiway frequency tables. The 
log— linear model represents the logarithm of the expected cell 
frequency as a linear combination of effects. According to Brown 
(1981), the log-linear model is similar to an analysis of variance 
(ANOVA) model except that the logarithm of the expected cell frequency 
replaces the expected value in the ANOVA model. The general log- 
linear model does not distinguish between independent and dependent 
variables; all variables are treated alike as "response variables" 
whose mutual associations are explored (Knoke and Burke, 1981). 

A likelihood ratio (L*^) is the statistic generated by a specified 

log-linear model. Large values indicate that the hy -ci ,d 

model does not fit the data well anJ should be rrjectec a 

inadequate Representation of tbv> relatiouship among the iables. 
Computing lr\« v* ^^-^ iol >wing process: 

^ Delecting variables for the model. Computer processing 
.imitations required the authors to collapse several variables' 
levels in the survey. 

2) Performing a hierarchical analysis to obtain the marginal and 
partial associations of the interrelationships of selected 
variabl-i^s. The authors examined these associations for main 
effects, two-way interactions, and three-way interactions. 

3) Specifying the log-linear model. After computing the marginal 
and partial associations through the hierarchical analysis the 
authors eliminated all effects that were not signif-^^ant at the 
.05 level for the log— linear model. 

The BMDP-4F statistical software package (Brown, 1981) was used 
to perform the five log-linear analyses. The two univariate analyses 
were conducted with the Statistical Package for the Social Sciences 
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(SPSS: Mie, Hull, Jenkins, Steinbr :inner , & Beut, 1975). The results 
of these seven analyses are presented below. 

Institutional Characteristics; 



The survey included four questions pertaining to institutional 
characteristics: type of institution, number of full-time or part- 
time students enrolled, percentage of adult students over the age of 
25, and the percentage of DISCOVER and SIGI users over the age of 25. 
Table 2 shows the level strata that the investigators determined for 
this model^s three quantitative variables. As indicated in Table 1, 
the following descriptive statistics were computed from data on these 
variables: number of full— time or part-time students, fewer than 
1,000 (27.0%), 1,000 to 4,999 (34.6%), 5,000 and over (38.4%); 
percentage of adults over age 25, M=: 29.8, SD= 21.0; percentage of 
DISCOVER or SIGI users over age 25, M=: 24.3, SD= 24.3. These 
statistics were used as guidelines in setting level strata. Thus, the 
institutional characteristics log— linear model was computed on five 
variables: the four named above and the System variable. Table 2 
displays the levels established for these variables. 

The hierarchical model designated from the f ive— var i able cross 
tabulation included all thre e— way interactions , two-' var ia ble 
parameters, single variable effects, and the grand main effect. After 
examining the partial and marginal associations for the full model, 
the non— s igni f i can t effects were eliminated and the following efforts 
were specified for the log-linear model: main effect of type x 
institution; main effect of percentage of adults over age 25; two— way 
interaction of the number of full— time or part— time students and 
percentage of adults over age 25; and two— way interaction of 
percentage of adults over age 25 and percentage of DISCOVER or SIGI2 
users over age 25. This model yielded the following statistics: L 
82. 25, df =» 48, p = .01. Inspection of Table 1 shows that high school 
institutions accounted for 44.2% of DISCOVER use but only 1.1% of SIGI 
use, while postsecondary DISCOVER and SIGI use was 47.3% and 91.3% 
respectively. SIGI was more likely to be used in larger institutions 
and to be part of a counseling center or career pi ann ing / pi ac emen t 
office as opposed to a guidance office. 

System Configuration 

Two questions addressing system configuration were presented: 
number of computer terminals or microcomputers available for DISCOVER 
or SIGI, and the location of these terminals and/or microcomputers. 
The investigators collapsed the latte item into two variables for the 
analysis, traditional location and nontraditional location. Thus, the 
system configuration log— linear model was computed on four variables: 
the three variables nar.ed above and the System variable. It should be 
noted that the level values specified for the number of terminals 
variable was set at 1 and greater than 1, respectively, on the basis 
of the item's distributional characteristics; 302 respondents (74.0%) 
reported the availability of a single terminal/microcomputer for 
system use. Table 3 presents Lhe variables and their levels that were 
established for the system configuration model* 
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The hierarchical model designated from the four-variable 
crosst abulation included all two— way interactions, single variable 
effects, and the grand main effect. After examining the partial and 
marginal associations for the full model, che nonsignificant effects 
were eliminated and the following effects were specified for the log- 
linear model: main effect of system; main effect of number of 
terminals; main effect of traditional location; main effect of 
non traditional location; two— way interaction of system and number of 
terminals; two— way interaction of number of terminals and traditional 
location; two— way interaction of number of terminals and 
nontradi tional location; and two— way interaction of traditional 
location and nontradi tional location. This model yielded the 
following statistics: L =" 7.02, df = 4, p = .14. 

Integration with Other Services 

Four items surveyed respondents' integration of DISCOVER and SIGI 
with other services. These items examined the method of referral, 
availability of auxiliary informational resources, use of the system 
as a component of student services programs, and availability of other 
computer applications. Thus, five variables were used in developing 
this log— linear model: the four variables named above and the System 
variable. Table 4 displays the levels established for these 
variables . 

The hierarchical model designated from the five-variable 
cross tabulati on included three way interactions, two-variable 
parameters, single variable effects, and the grand main effect. After 
examining the partial and marginal associations for the full model, 
the non-significant effects were eliminated and the following effects 
were specified for the log— linear model: main effect of method of 
referral; main effect of auxiliary informational resources available; 
main effect of system use as a component of student services programs; 
main effect of other computer applications available; two-way 
interaction of system and system use as a component of student 
services programs; two— way interaction of method of referral and 
auxiliary informational resources available; and two-way interaction 
of auxiliary Informational resources available and system use as a 
component of student services programs. The following results were 
computed from this model: L"^ « 24. 79, df = 23, p = .36. 

Counselor and Staff Intervention 

The survey included five questions pertaining to counselor and 
staff intervention. Specifically, the data related to the method of 
counselor intervention, staff members providing services, time of 
intervention, staff availability, and type of support materials 
available. Thus, six variables were used in developing the counselor 
and staff intervention log— linear model: the five variables named 
above and the System variable. Table 5 displays the levels 
established for these variables. 



11 



ERIC 



7 



The hierarchical model designated from the six— variable 
cross tabuJ a tion included all three-way interactions, two-variable 
parameters, single variable effects, and the grand main affect. The 
following effects were specified for the log-linear model after the 
model's non— signif icant effects were removed: main offect of system; 
main effect of method of counselor intervention* main effect of staff 
members who provide services; main effect of time of intervention; 
main effect of staff availability; main effect of type of support 
materials available; two— way interaction of system and type of support 
materials available; two— way interaction of method of counselor 
intervention and staff members who provide services; two— way 
interaction of method of counselor intervention and time of 
intervention; two— way interaction of staff members who provide 
services and time of intervention; and two— way interaction of staff 
availability and type of support materials available. The log— linear 
model from these effects generated the following results: L =: 57.52, 
df = 52, p = .28. 

Usage Statistics 

Five items surveyed respondents' usage statistics. These items' 
directions instructed the respondents to: estimate the total number 
of different persons using DISCOVER or SIGI in the 1982-83 school 
year; estimate the average total time (per student) spent using the 
system; estimate the average time length of a student appointment; 
estimate the average number of appointments per student; and estimate 
the average amount o£ time that elapses between making an appointment 
and system use. Thus, six variables were used in developing the usage 
statistics log— linear model: the system variable and the five 
variables derived from the preceding items. The levels established 
for the variables are detailed in Table 6. The five quantitative 
variables were associated with the following distributional 
statistics: number of system users in the 1982—1983 school year, M = 
318.1, SD = 472. 0 (range =: 5 to 6,000); average total time spent using 
the system (minutes), M =149.8, SD = 71.1; average length of 
appointments (minutes), M ==77.1, SD = 41.3; average number of student 
appointments, M « 2.4, SD = .8; and average time between making an 
appointment and using the system (days), M = 3.7, SD = 2.9. 

The hierarchical model designated from the six— variable 
cross tabula tior included all three— way interactions, two— variable 
parameters, single variable effects and the grand main effect. After 
eliminating the full model's non-significant effects, the following 
effects were specified for the usage statistics log-linear model: 
main effect of system; main effect of number of system users in the 
1982-1983 school year; main effect of average total time spent using 
system; main effect of average time length of appointment; main effect 
of average number of student appointments; main effect of average time 
between making an appointment and system use; and two-way interaction 
of system and average total time spent usin^ system. A log— linear 
model produced the following statistics: L = 51.29, df = 44, p « 
.21. 
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Univariate Data Analyses 



earlier, uni. .riatc analysec; were performed on Items 
from 2 su *vey nreas: System lanagement and System Implementation. In 
the first ^n, System Management, a log-Ilnear model could not be 
speci-'^ed: h06 of the sample's 408 respondents had data missing on 
one or '^t' u variables used to specify the general log— linear uiodel • 
In the second area. System Implementation, the hierarchical analysis 
generated a saturated log— linear model (i.e., no dimension reduction 
occurred subsequent to an analysis of marginal and partial 
associations). For these reasons the authors proceeded to analyze 
items from the two areas using t— tests and chi-square analyses. 

S ystem Management 

The following statistics pertain to the number of months that the 
par *-icipating institutions reported using either DISCOVER or SIGI: 
DISCOVER, M « 9.87, SD = 7.70; SIGI, M « 20.62, SD « 14.19. Two 
univariate t— tests were performed to examine potential differences in 
the systems' availability for student use. The first t-test examined 
the number of days per week that the systems were available for 
student use » This analysis showed no significant differences between 
DISCOVER and SIGI respondents, t « -1.55, df=« 332, p « .12. The 
second t-test examined the number of hours per day that the systems 
were available for stud'int use; significant differences were found 
between the groups, t = -3.66, df = 317, p = .01. Table 7 displays 
the results of these analyses. Inspection of Table 7 shows that 
DISCOVER and SIGI were available 7.85 and 9-62 hours per day 
respective ly . 

The authors performed a series of chi— square analyses (see Table 
8) to examine potential differences between survey participants' 
strategies for evaluating the system's impact. The results indicated 
that only one evaluation strategy, using the number of students 
served, was significantly different between the two Groups, x « 7.34, 
df « 1, p « .01. Inspection of Table 8 shows that SIGI in comparison 
to DISCOVER respondents were more likely to include data on the number 
of students served, 84.3% to 71.0%. 



Sys tem Impl ementa t ion 

Planning completed on an ad— hoc basis was the most common system 
implementation planning method used by both DISCOVER (50.5%) and SIGI 
(31.8%) respondents. The authors conducted a chi-square analysis of 
potential differences in planning method, a formal planning method or 
no planning method, by each Group. As Table 9 shows, there were no 
significant differences, x^ * .16, df « 2, p » .93. 

Chi— square analyses were also performed to examine potential 
differences in the Groups' providers of staff training during system 
implementation. As indicated in Table 10, only one significant chi- 
square value was computed: significant differences in the use of 
system developers as trainers were found, x * 6.74, df = 1, p « .01. 
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Twenty-five percent of the respondents from DISCOVER sites indicated 
that system developers provided staff training during the 
implementation process, compared to 12.9 % of the respondents from 
SIGI sites. 

Discussion 

This study sought to identify the extent to vhich software-based 
or institutional-based factors influenced the national use of DISCOVER 
and SIGI. The assumption was that if overall significant differences 
did exist in DISCOVER and SIGI use, then software-based factors would 
have a stronger effect on system use than ins t i t u t i ona 1— b a s e d factors. 
Results revealed few statistically significant differences in the use 
of DISCOVER and SIGI, and the few that were noted could probably be 
attributed to differences in the type and size of institutions using 
each s ys t em . 

Data from ^his investigation suggests that several 
institutionally-based factors are largely determining DISCOVER and 
SIGI use. The day— to— day use of these systems does not seem to be 
strongly influenced by sof t ware— based factors. Given the sampler's 
diversity, these results can probably be generalized to most sites 
offering CACG systems. Institutions planning to implement a CACG 
system could use the in s t i t u t i o nal ly — b as ed factors on current system 
use, reported by Sampson, Shahna s ar i an , and Reardon (1985), as generic 
base— line data to relate their system planning to national trends. 

The few differences that emerged in these systems' use may be 
related to the fact that SIGI has been used principally in higher 
education settings, while DISCOVER has been used in a diversity of 
settings ranging from high schools to post-secondary institutions. 
Differences in system developers' participation in staff training is 
possibly related to this host site diversity, but may also be included 
in s of tware— based variables. 

Conceivably, by their very nature, ins ti tut ionally— based factors 
will continue to be the dominant influence in CACG system utilization. 
Problems may surface, however, when sof tware— based factors, such as a 
system's theoretical foundation, are not fully understood and 
accommodated into an institution's philosophy of services. For 
example, it could be confusing to counselors and clients if the CACG 
system selected used aptitudes as the focal point for identifying 
occupational alternatives and the host institution used Holland's 
(1985) personality typology to guide the exploration process. 

Snipes and Mc Daniels (1981) urged counseling professionals to 
evaluate CACG systems in light of the theoretical bases for system 
designs. Harris-Bowlsbey (1983) stressed the importance of 
implementing a CACG system within the philosophical (theoretical) 
context of an office's service delivery goals. Given the notion that 
theory should be used to guide practice, e.g., Amatea (1984), Brammer 
and Shostrom (1982), Harris-Bowlsbey (1984a; 1984b), and Osipow 
(1983), a CACG system's effectiveness could possibly be enhancec if 
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its theoretical assumptions are congruent with the theoretical 
assumptions underlying service delivery in che office housing it. 

Several explanations could account for the general lack of 
software-based factors, especially system's theoretical bases, in 
systems use. First, counselors and administrators who design and 
deliver services may not fully understand the theoretical assumptions 
inherent in CACG system design and content* In this case; even If 
staff members aspire to integrate theory and practice, they may lack 
the knowledge to complete this task. Deficient staff training in CACG 
use, noted by Sampson, Shahnasar Ian , and Reardon ( 1 985), is likely 
problematic at many sites. 

Second, trainir.g materials that have been available may 
inadequately describe the theoretical assumptions inherent in CACG 
system design and content. Again, integrating theory and practice, 
even if staff members sought to accomplish this task, would be 
virtually impossible without relevant systems' information. 

Third, although DISCOVER and SIGI have different theoretical 
assumptions, perhaps the differences are insufiicient to generate 
differential impacts on service delivery. A set of generic core 
concepts could possibly underlie both theories, thus accounting for 
the systems' similar utilization. 



Implications 



There is strong, longstanding support in the profession for using 
theory to guide the design and delivery of counseling and guidance 
services. In view of this issue's critical importance and the lack 
of differential impact of software-based factors (especially theory) 
found in this investigation, a variety of priorities for strengthening 
the relationship between theory and practice are suggested below. 



Priorities for Researchers 



Researchers can strengthen the relationship between theory and 
practice by: 1) further testing the theoretical assumptions that 
underlie various CACG systems; 2) examining the extent to which theory 
is fully integrated into various CACG systems; 3) investigating 
counselors' and administrators' understanding of the theoretical 
assumptions underlying the CACG system(s) they are using; 4) examining 
the quality of staff training materials, paying specific attention to 
the topic of integrating theory and practice; and 5) conducting 
further investigations on the differential impact of CACG theoretical 
assumptions on professional practice in order to better develop and/or 
select dependent measures sensitive to the impact of theory as opposed 
to other institutionally-based factors. 

Priorities for System Developers 

System developers can strengthen the relationship between theory 
and practice by: 1) utilizing a theoretical foundation for system 

15 
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development and subsequent revision; 2) developing training materials 
that fully describe their system^'s theoretical foundation; and 3) 
developing training materials that fully describe the relationship 
between theory and practice, with examples from settings providing 
career counseling and guidance services* 

Priorities for Practitioners 



Practitioners can strengthen the relationship between theory and 
practice by: 1) selecting a CACG system congruent with their 
theoretical perspective; and 2) taking advantage of existing training 
opportunities* A resource that can be used to support this effort is 
the booklet Guidelines for the Use of Computer-Based Career 
Information & Guidance Systems , developed by the Technical Assistance 
and Training Committee of ACSCI (Caulum & Lambert, 1985)* These 29 
guidelines for varied user site personnel, cover the topics of theory 
and practice, process, user needs, system site management, physical 
environment, personnel, and evaluation. 
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Table 1 

Descriptive Data on Survey Items by System 



It em 
No . 



Sy s t em 



DISCOVER 
(n = 224) 



Fr eq . 



% 



K 



SD 



INSTITUTIONAL CHARACTERISTICS 
2 Type of Institution 
High School 
Vo/Tech School 
Community College 
Four— year college 
llnivirsity 
Other 



How many full— time 
part— time students 
enrolled at your 
institution? 

Fewer than 1000 

1000 to 4999 

5000 to 9999 



or 
are 



10,000 
15,000 
20,000 
25, 000 
30,000 



to 
to 
t o 
to 
to 



14,999 
19,999 
24,999 
29,999 
34,999 



Over 35,000 

Estimate the percentage 
of adult students over the 
age of 25 who are attending 
your institution. 



99 
5 
33 
28 
45 
12 



83 

74 
24 
18 
4 
3 
5 
1 
3 



44 . 2 
2 . 2 
14. 7 
12.5 
2 0. 1 
5.4 



37.1 
33.0 
10.7 
8.0 

1 . 8 
1 . 3 

2 . 2 
. 4 

2 . 2 

29.7 21.4 



SIGI 
(n => 184) 



Fr eq . 



% 



M 



2 

3 
43 
65 
60 
1 1 



27 
67 
25 
21 
13 
11 
2 
3 
3 



1 . 1 
1.6 



23, 
35, 
32, 

6, 



SD 



14.7 
36.4 
13.6 
11.4 

7. 1 

6 . 0 

2.7 

1 . 6 

1.6 

29.8 20.8 



(table continues ) 
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Item System 
No . 



DISCOVER 
(n = 2 24) 



Fr eq 



% 



M 



SD 



5 Estimate the percentage 
of your DISCOVER or SIGI 
users who are adult 
students over the age of 25 

SYSTEM CONFIGURATION 

6 How many computer 
terminals or nlcro— 
computers are available 
on your campus for 
students to use 
DISCOVER or SIGI? 



22.5 2 5.9 



1.4 2.8 



SIGI 
(n = 184) 



Fr eq 



% 



M 



SD 



25.6 23.1 



2.4 5.9 



Wh2t is the location of 

DISCOVER or SIGI computer 

terminals or microcomputers 

on your campus? (Up to 

three responses.) 
Guidance office 77 34.4 

Counseling center 43 19.2 

Career center 58 25.9 

Placement center 6 2.7' 

Combined career plan— 41 18.3 

ning and placement 
Library 11 4.9 

Residence hall 0 0 

Learning skills center 7 3.1 

Other 27 12.1 



4 
64 
43 
1 4 
74 

1 0 
5 
7 

2 5 



2.2 
34.8 
23.4 

7.6 
40.2 

5.4 
2. 7 
3.8 
13.6 



INTEGRATION WITH OTHER SERVICES 
8 How are students refer- 
red to DISCOVER or SIGI? 
Individual counseling 204 



Group counseling 
Career course 
Walk— in basis 
Other 



109 
130 
176 
77 



91.1 
-+8.7 
58.0 
78.6 
34.4 



178 
91 
127 
160 
81 



96.7 
49.5 
69.0 
87.0 
44.0 



(table continues) 
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Item 
No . 



Sys tern 



DISCOVER 
(n = 224) 



SIGI 
(n = 164) 



Fr eq 



% 



M 



SD 



Fr eq , 



Which other informational 
resources are available 
to students at your 
institution who use 
DISCOVER or SIGI? 



M 



Books, pamphlets. 


215 


96.0 


179 


97.3 


files , etc . 










Audio tapes 


95 


42.4 


85 


46.2 


Filmstrips 


96 


42.9 


78 


42.4 


Video tapes 


72 


32. 1 


86 


46.7 


On— the— job interviews 


93 


41.5 


105 


57.1 


Internships 


75 


33.5 


109 


59.2 


Te s t s / i n V entories 


193 


86.2 


175 


95.1 


Work experience 


118 


52.7 


1 02 


55. 4 


p rogr ams 










Other 


33 


14.7 


27 


14.7 



SD 



10 Is your system used 
as a component of the 
following programs? 

Academic advisement 
Admissions recruit- 
ment programs 
Retention programs 

11 Which other computer 
applications are 
available in your 

o f f i ce / cen t er ? (does 
not include word 
processing) 
Computer— assisted 
career library 
indexing system 
Compute r—assi s ted 

testing system 
Computer— assisted 

personal system 
Computer— assi St ed 

instruction system 
Other 



149 
70 



21 



66.5 
31.3 



7 5 3 3.5 



9.4 



25 11.2 
18 8. 0 
45 20.1 

26 11.6 



96 
62 



11 

13 
7 
18 



52. 2 
33.7 



87 47.3 



6. 0 

7. 1 
3.8 
9.8 



32 17.4 

(table continues) 
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Item 
No . 



Sys tem 



DISCOVER 
(n = 22A) 



SIGI 
(n = 184) 



i? r eq . 



SD 



i? r eq 



H 



SD 



12 Which compr. ter- 
asslsted career 
information systems 
are available for 
student use at your 
institution in addit- 
ion to SIGI or DISCOVER? 

CVIS 

CIS 

CIS 

CHOICES 

COIN 

Other 



0 
8 

16 
4 
9 

18 



0. 0 
3.6 
7. 1 

1 . 8 
4.0 
8.0 



0 
4 

13 
0 
4 

24 



0.0 
2.2 
7. I 
0.0 
2. 2 
13.0 



COUNSELOR AND STAFF 
INTERVENTION 

13 If counselor 
intervention is 
provided to assist 
students in obtain- 
ing maximum benefit 
from using DISCOVER 
or SIGI, what method 
is used to deliver 
the intervention 

Individual counseling 
Group counseling 
Classroom 
Other 

14 If counselor inter- 
vention is provided, 
what type of staff 
members provide the 
intervention? 

Professional ly 
trained counselors 
(masters & doctoral) 



211 
103 
92 
8 



94 . 2 
46.0 
41.1 
3.6 



213 95.1 



176 
46 
69 
9 



95.7 
25.0 
37.5 
4.9 



172 93.5 
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Item System 
Nr . 



15 



16 



DISCOVER 
(n = 224) 



SIGI 
(n = 184) 



Fr eq 



% 



M 



SD 



Fr eq . 



% 



Faculty members 42 18.8 

Paraprof essionals 84 37.5 

Other 22 9.8 

If counselor intervention 
is provided, at what 
point(s) during the 
student's use of your 
system does the inter- 
vention take place? 
Prior to system use 199 88.8 

Between sessions at 148 66.1 

the computer 
After the student has 
completed the system 



185 82.6 



Indicate the availability 
of a staff member (clerical 
support, paraprof essional , 
faculty member or counselor, 
in or near the room where 
the computer terminal is 
located) to readily answer 
student questions and deal 
with problems, while the 
student is using your 
s ys tem : 

Not available 2 
Available some of 17 

the time 
Available most of 6 9 

the time 
Available all of 131 

the time 



. 9 

7.6 

3C . 3 
58.5 



26 
66 
19 



160 
100 

169 



3 

1 3 



14.1 
3 5.9 
10. 3 



87 . 0 
54. 3 

91.8 



1 . 6 
7 . 1 



M 



SD 



43 23.4 
123 66.8 
( table continues) 
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Item 
No . 



System 



DISCOVER 
(n - ?.2 4) 



SIGI 
(n = 184) 



r r eq o 



M 



SD 



Freq 



M 



SD 



17 Which of the following 
support materials are 
available to students 
who use your system? 

General user guide 
List of occupations 
Audio tape presentation 
Slide/ nape presentation 
Video tape presentation 
Supplemental exercises 
Other 

No other support 
materials available 

USAGE STATISTICS FOR ALL USERS 

18 Estimate the total number o 
different persons who used 
DISCOVER or SIGI in the 
1982-83 school year. 



19 Estimate the average total 
time (per student) spent 
using DISCOVER or SIGI (min.) 

20 Estimate the average time 
length of a student 

a ppo in tmen t ( mln • ) 

21 Estimate the number of 
appointments per student 



207 


92. 4 


125 


67 . 9 


17 1 


76.3 


170 


92.4 


1 1 


4.9 


3 


1 . 6 


8 


3 . 6 


8 


4.3 


20 


8. 9 


5 


2.7 


35 


15.6 


42 


22.8 


28 


12. 'j 


20 


10.9 


2 


. 9 


4 


2o 2 


f 


293.5 580.9 




338.6 



109. 2 



62.9 



2.3 



53 . 8 



27.9 



.9 



358. 5 



190.1 62.7 
9 1.6 47.3 

2.5 .8 

(table conti nues ) 
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Item 
No. 



Sy s t em 



DISCOVER 
(n - 224) 



SIGI 
(n = 184) 



Fr eq 



M 



SD 



Breq • 



% 



M 



SD 



22 



Estimate the average 
amount of time that 
elapses between making 
an appointment and 
beginning to use your 
system (days) 



SYSTEM MANAGEMENT 
24 How long have you 
been using the 
following systems? 

1 DISCOVER 

2 SIGI 



3. 3 



4.1 3.4 



25 



26 



27 



9.9 7.7 



How many days per 
week is your system 
available for student 



5.0 



. 3 



use? 



How many hours per day 
(on the average— Monday 
through Friday) is your 
system available for 
student use? 

Which of zhe following 
strategies are you 
using (or have you 
used) to evaluate the 
impact of your system 
on the students you 
serve ? 

1) Number of students 
served 

2) Student satisfaction 
with the system 

3) Student knowledge 
of self 

4) Student knowledge 
of occupations 



7.9 2.0 



27.3 21.0 
5.2 .4 

10.0 6.8 



159 71.0 



163 72.8 



61 27.2 



64 28.6 



156 84.8 
137 74.5 

48 26.1 

42 22.8 
( table con t inue s ) 
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Item System 
No . 



DISCOVER 
(n = 224) 



r e q 



% 



M 



SD 



SIGI 
(n ■= 184) 



Freq. % M SD 



5) 



6) 
7) 



Student knowledge 
of career decision 
ma king 
Other 

No evaluation data 
is being (or has 
been) collected 



73 32.6 



27 12.1 
38 17.0 



IMPLEMENTATION OF YOUR SYSTEM 
28 Which of the following 

planning methods were used 
in implementing youf system? 



29 



1) Formal plan with 
identified steps and 
time frames 

2) Planning completed on 
an ad— hoc basis as 
resources become 
available 

3) No planning method 
used 

Indicate who provided 
staff training during the 
implementation of your 
sys tem 

1) In— house trainers 

2) Outside trainers 

3) System developers 
(ACT or ETS) 

4) No staff training 
was available 



83 37.1 



110 49.1 



25 11.2 



120 
36 
56 



53. 
16, 
25, 



6 
1 
0 



56 25.0 



48 26.1 



26 14.1 
23 12.5 



74 40.2 
81 44.0 

2 1 11.4 



95 
2 7 
35 



5 1.6 
14.7 
19.0 



53 28.8 
( table continues) 
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Item 
No . 



System 



DISCOVER 
(n « 224) 



SIGI 
(n =» 184) 



Freq . 



% 



M 



SD 



Freq. % M SD 



POTENTIAL NEEDS 

30 Indicate what might 
be done to improve 
the quality of your 
compute r— assisted 
career guidance 
p rogr am • 

1) Identification of 
instruments for 
evaluation studies 

2) Inservice training 
for counselors 
and other staff 
member s 

3) Networking with 
other institutional 
si tes 

4) Specific strategies 
for using DISCOVER 
and SIGI with re- 
turning adult 
students 

5) Other 



117 52.2 



110 49.1 



89 39.7 



112 50.0 



111 60.3 



95 51.6 



95 51.6 



129 70.1 



74 33,0 



43 23.4 
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Table 2 

Variables Used in the Institutional Characteristics Model 



Variable No. of Level Values 

Le ve 1 s 



System 2 Level 1 =: DISCOVER 

Level 2 SIGI 

Type of Institution 3 Level 1 = high school 

Level 2 « community college; 

vocational /technical school 
Level 3 « four— year college; 
uni ver sit y 



No. of full— time 


3 


Le ve 1 


1 




fewer than 1,000 


or part— time 


students 




Le ve 1 


2 




1 , 000 to 4 , 999 








Le ve 1 


3 


3X 


5,000 and over 


Percentage of 


adults 


2 


Le ve 1 


1 


SX 


0% to 25% 


over age 25 






Le ve 1 


2 




26% to 100% 


Percentage of 


DISCOVER 


2 


Le ve 1 




1 


= 0% to 13% 


or SIGI users 


over 




Leve 1 


2 


33 


14% to 100% 



age 25 



20 



Table 3 

Variables Used in System Configuration Model 



Variable No. of Level Values 

Leve 1 s 



Sy s t em 


2 


Leve 1 1 


= DISCOVER 






Level 2 


= S iCI 


No* of terminals/ 


2 


Level 1 


» 1 


mi crocomp ut e r s 




Level 2 


» 2 or more 


Traditional location 


1 


Level 1 


=* guidance 






office 


; counseling 



center; career center; 
placement center; 
comb in ed career planning 
and placement 

Non t radi t ional 1 Level 1 = library; 

location residence hall; learning 

skills center; other 



30 



Table 4 

Variables Used in Integration with the Other Services Model 



26 



Variable 



Uo • of 

Le ve 1 s 



^-evel Values 



Sys t em 



Le ve 1 1 
Level 2 



DISCOVER 
S IGI 



Method of 
referral 



Auxiliary 
informational 
resources a^/ailable 



System use as a 
component of 
student services 
p r og r ams 



Other computer 
appl ica tions 
available 



Level 1 = individual 

counseling; group 

counseling; career course 
Level 2 =» walk— in basis ; 

other 

Level 1 » books, pamphlets, 

files, etc.; audio tapes; 

filmstrips; video tapes; 

tests/ inventories 
Level 2 =« on— the— job 

interviews ; internships ; 

work experience programs; 

o ther 

Level 1 « academic advise- 
ment ; admissions 
recruitment; retention 

Level 2 « not used in 
student services programs 

Level 1 « career library 

indexing system; testing 

system; personal 

counseling system. 

Instruction system; other 
Level 2 » no other computer 

applications available 
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Table 5 



Variables Used in the 


Co un s e 1 o r 


and Staff Intervention Model 


Variable 


No • of 

Le vel s 


Level Values 


Sys t em 


2 


Level 1 « DISCOVER 
Laval 2 ^ SIGI 


Method of counselor 
i n t e r ven t ion 




Level 1 individual 

counseling 
Level 2 group counseling; 

classroom; other 


Staff members who 
provide services 


2 


Level 1 » professionally 
trained couns el o r s 
(masters and doctoral 
level) 

Level 2 » faculty members ; 
paraprofessionals; other 


Time of 
intervention 


2 


Level 1 =» prior to system 
use; after system use 

Level 2 =» between computer 
sessions 


Staff availability 


2 


Level 1 «= not available 
Level 2 « available some of 
the time; available most 
of the time; available all 
of the time 


Type of support 
materials 
avail able 


2 


Level 1 list of 
occupations 

Level 2 » general user 
guide; audio tape present- 
ation; slide/tape present- 
ation; video tape present- 
ation; supplemental 
exercises; other 
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Table 6 



Variables Used in the 


Usage 


Statistics 


for 


Al 1 Users Model 


Variable 


No . of 


Level 


Value s 




Levels 










System 


2 


Le ve 1 


1 


=3 


DISCOVER 




Level 


2 


a 


SIGI 


No • of system 


3 


Le ve 1 


1 


= 


0 - 200 


users in the 




Level 


2 


S3 


201 - 400 


'82-'83 school yr. 




Le V e 1 


3 


= 


4 0 1 and above 


Av g . total time 


3 


Le V e 1 


1 




60 min • or less 


spent using the 




Le ve 1 


2 




61 - 120 min. 


s ys t em 




Level 


3 




more than 120 min. 


Avg, time of 


3 


Le ve 1 


1 




6 0 min • or less 


a ppo in tmen t 




Level 


2 




61 - 120 min. 






Le ve 1 


3 




more than 120 min. 


Avg. number of 


3 


Le ve 1 


1 


3K 


1 


s t ud en t 




Level 


2 




2 


ap po in t men t s 




Le ve 1 


3 




3 or more 


Avg. time between 


3 


Level 


1 




less t han 2 


making an 




Le ve 1 


2 




2-4 


appointment and 




Level 


3 




4 or more 



s y s t em use 
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Table 7 

t— tests Comparing DISCOVER and SIGI Respondents on Availability of 
Systems for Student Use 



Availability/ Group 



Me an 



SD 



Days per week 
DISCOVER Respondents 5,03 
SIGI Respondents 5.09 



c34 -lo55 
.42 



Hours per day 
DISCOVER Respondents 7.85 
SIGI Respondents 9.62 



2,05 -3.66 .01 
6.36 
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Table 8 

Chi-square Analyses of Evaluation Strategy by Group 



Evaluation Strategy 



Gr oup 



DISCOVER SIGI X 

Respondents Respondents 



30 



No. of students served 
pc t • 

Student satisfaction 
pc t . 

Student knowledge 
of self 

pc t . 

Student knowledge 
of occupations 
pet. 

Student knowledge 
of career decision 
making 

pc t . 



Other 



pet 



No evaluation daua 
collected 

pet . 



71.0 



72 . 8 



27. 2 



28* 6 



32. 6 



12.1 



17.0 



84 . 3 



76.5 



27.8 



26.1 



29.6 



12.2 



13.0 



7.34 .01 



.55 .45 



.01 .91 



.23 .63 



.32 .57 



.01 .97 



.88 .35 



Note: Due to the multiple response format of this item. 



percentages may not total 100%. 
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Table 9 

Contingency Table of Implementation Planning Method by Group 



Impletnenta t ion Planning Group 
Method 



DISCOVER SIGI 

Re s po nd e n t s Re s po nd e n t s 



Formal plan 

pet . 38. 1 36.0 

Ad— hoc basis 

pet . 50.5 51.8 

No plan 

pet . 11.5 12.3 



« . 16, df - 2, p = .93 
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Table 10 

Chi-square Analyses of Staff Training Providers During System 
Implementation by Group 



Staff Training 
Provid er 



Gr oup 



DISCOVER 
Respondents 



SIGI 

Respondents 



In— house trainers 
pet . 

Outside trainers 
pet . 



53. 6 



16.1 



56.0 



13.8 



. 19 



31 



.67 

. 58 



System developers 
pet . 



25.0 



12.9 



6.74 



.01 



No staff training 
provided 
pet . 



25.0 



31.0 



1.41 



.24 



Note: Due to the multiple response format of this item, pereentages 



may not total 100%. 
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Appendix 
Survey Instrument 
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Survey of Institutions Using DISCOVER and SIGI 



Clearinghouse for Computer-Assisted Guidance Systems 
Project LEARN - Phase II 
Florida State University 



Directions : 

Please choose the most appropriate response and place the number in 
the space or spaces along the right margin. 

System(s) Currently in Use 

1. Indicate the system or systems (up to two responses) that you 

currently use 

(1) DISCOVER (on a mainframe computer) (2) DISCOVER (on a microcomputer 

(3) SIGI (on a mainframe or a minicomputer) or a minicomputer) 

(4) SIGI (on a microcomputer) 

Institutional Characteristics 



2. Type of Institution? 

(1) high school (2) vocational/ technical school 

(3) conmiunity college (4) four-year college 

(5) university (6) other 



3. How many full-time or part-time students are enrolled at your institution? 

(1) fewer than 1,000 (2) 1,000 to 4,999 (3) 5,000 to 9,999 

(4) 10,000 to 14,999 (5) 15,000 to 19,999 (6) 20,000 to 24,999 
(7) 25,000 to 29,999 (8) 30,000 to 34,999 (9) over 35,000 

4. Estimate the percentage of adult students over the age of 25 who are attending 
your institution 

% 



5. Estimate the percentage of your DISCOVER or SIGI users who are 

adult students over the age of 25. 

System Configuration 

6. How many computer terminals or microcomputers are available on your 

campus for students to use DISCOVER or SIGI? 



What is the location of DISCOVER or SIGI computer terminals or microcomputers 
on your campus? (up to three responses) 

(1) guidance office (2) counseling center (3) career center 

(4) placement center (5) combined career planning 

and placement 

(6) library (7) residence hall (8) learning 

skills cent^ 

(9) other 
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Integration with Other Service s 

8. How are students referred to DISCOVER or SIGI? 

(1) individual counseling (2) group counseling 

(3) career course (.4) walk-In basis 

(5) other 

9. Tfliich other Informational resources a^e available to students at your 
Institution who use DISCOVER or SIGI? 

aud io tap es 



(1) 


books , pamphlets 5 


C2) 




files, etc. 




(3) 


f llmstrlps 


(4) 


(5) 


on-the-job 


C6) 




Interviews 




(7) 


tests/ inventories 


(.8) 


(9) 


other 





video tapes 
internships 

work experience programs 



10. Is your system used as a component of the following programs' 



academic advisement 


(1) 


yes 


(2) 


no 


admissions recruitment 


CD 


yes 


(2) 


no 


programs 


CD 




(2) 




retention programs 


yes 


no 



11. Which other computer applications are available in your of flee/ center? 
(do not Include word processing) 

computer-assisted career library Indexing system (1) yes C2) no 

computer-assisted testing system (D yes (2) no 

computer-assisted personal counseling system CD yes (2) no 

computer- as sis ted Instruction system (1) yes (2) no 

other (1) (2) no 



12. Which computer-assisted career information systems are available for student 
use at your institution in addition to SIGI or DISCOVER? 

CVIS (1) yes (2) no 

CIS CD yes C2) no 

GIS (1) yes (2) no 

CHOICES CD yes (2) no 

COIN CD yes (2) no 

Other CD yes C2) no 

Counselor and Staff Intervention 

13, If counselor intervention is provided to assist students in obtaining 
maximum benefit from using DISCOVER or SIGI, what method is used to deliver 
the intervention? 

(enter 0 if no counselor Intervention is provided) • 



(1) individual counseling (2) group counseling 
(3) classroom (4) other 
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14. If counselor intervention is provided, what type of staff members provide the 
intervention? (entei 0 if no counselor intervention 



CD professionally trained counselors (masters & doctoral level) 

(2) faculty members 

(3) paraprof essionals 

(4) other . 

15. If counselor intervention is provided, at what pointG^uring the student's 
use of your system does the intervention take place? 

(enter 0 if no counselor intervention is provided) • _ 



(1) prior to system use 

(2) between sessions at the computer 

(3) after the student has completed the system 

16. Indicate the availability of a staff member (clerical support, paraprof essional , 
faculty member or counselor, in or near the room where the computer erminal 

is located) to readily answer student questions and deal with problems, 

while the student is using your system: 

CD not available (2) available some of the time 

(3) available most of the time (A) available all of the time 

17. Which of the following support materials are available to students 
who use your system? 



(1) general user guide (2) list of occupations 

(3) audio tape presentation (4) slide/tape presentation 

(5) video tape presentation (6) supplemental exercises 

(7) other (8) no support materials 

available 

Usage Statistics for All Users 

18. Estimate the total number of different persons who used 
DISCOVER or SIGI in the 1982-83 school year 



19. Estimate the average total time (per student) spent using Chrs.) 

DISCOVER or SIGI 

20. Estimate the average time length of a student appointment (hrs.> 

21. Estimate the average number of appointments per student 

22. Estimate the average amount of time that elapses between making 

an appointment and beginning to use your system (days) 

System Management 

23. Indicate the title of the individual at your institution who has direct 
responsibility for managing your systemt_ . 
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24. How long have you been using the following systems? 

DISCOVER (yrs,) (mos,) 

SIGI (yrsO (mos.) 

25. How mnny days per week is your system available for 

student use? (days) 

26. How many hours per day (on the average - Monday through 

Friday) is your system available for student use? (hrs.) 

27. Which of the following strategies are you using Cor have you used) 
to evaluate the Impact of your system on the students you serve? 



(1) number of students served (2) student satisfaction with the system 

(3) student knowledge of self (4) student knowledge of occupations 

(5) student knowledge of career (6) other 

decision making 
(7) no evaluation data is being 

(or has been) collected 

Implementation of Your System 

28. Which of the following planning methods were used in implementing your 
system? 

(1) formal plan with identified steps and time frames 

(2) planning completed on an ad-hoc basis as resources become available 

(3) no planning method used 

29. Indicate who provided staff training during the implementation of your 
system. 

CD in-house trainers C2) outside trainers 

C3) system developers C4) no staff training was available 

CACT or ETS) 

Potencial Needs 

30. Indicate what might be done to improve the quality of your computer- 
assisted career guidance program. 

Cl) identification of instruments appropriate 

for evaluation studies 
C2) inservice training for counselors and other 

staff members 

(3) networking with other institutional sites 

(4) specific strategies for using DISCOVER and SIGI with returning 
adult students 

(5) other . 

(6) other 

(7) other 

(8) other 
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